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(57) ABSTRACT 

This invention is related to a three-dimensional measuring 
device for measuring three-dimensional positions of an 
objects. The three-dimensional measuring device comprises 
an optical projection system and an optical reception system. 
In a preliminary measurement prior to an actual 
measurement, the optical projection system projects slit light 
beam on the object with varying projection angle with in a 
narrow range, and the optical reception system receives the 
slit light beam reflected by the object and generates image 
- signals corresponding to an amount of the received light 
synchronously with variation of the projection angle. Mea- 
surement conditions including intensity of the light beam 
and the projection angle for the actual measurement are set 
in accordance with the image signals of the actual measure- 
ment. Under the measurement conditions, the actual mea- 
surement is executed by projection the light beam on the 
object with varying the projection angle within a wide range. 

13 Claims, 47 Drawing Sheets 
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THREE-DIMENSIONAL MEASURING Dates point P (X,Y,Z) on the object, and the angle of the 

DEVICE AND THREE-DIMENSIONAL projection axis and projection reference plane (projection 

MEASURING METHOD plane parallel to the light reception axis) is designated 6a, 

and the light reception angle is designated Op, the coordi- 

This application is a Divisional of Application Ser. No. 5 nates Z of point P are expressed by the equation below. 
08/748,325 filed Nov. 13, 1996 now U.S. Pat. No. 6,141, 

|Q5 Base line length 2^Ztan 6o+Ztan Op 

BACKGROUND OF THE INVENTION - -**/(t»n to+tan Op) 

1 Field of the Invention 10 ^ ^ receiving angle 9p is the angle formed by a line 
* . . , connecting point P and principal point O, and the plane 

The present invention relates to a three-dimensional mea- including the light reception axis (i.e., light reception axis 
sunng device and Uiree-dimeosional measuring method for plane). 

non-contact measuring of an object shape by ffluminating an since the imaging magnification P=b/Z, when the dis- 

object with light. 15 tance between the center of imaging surface S2 and the light 
2. Description of the Related Art reception pixels in the x direction is designated xp and the 

Three-dimensional measuring devices of the non-contact distance in the Y direction is designated yp (refer to FIG. 

type commonly referred to as rangefinders are used for data 47a), the coordinates X,Y of point P are expressed by the 

input to CG systems and CAD systems, somatometry, robot equations below. 

visual recognition and the like because it is possible to 20 

measure at high speed compared to contact type devices. X=*pW 

The optical slit projection method (also referred to as the r=»VP 

light section method) is known as suitable measuring 

method for rangefinders. Tins method produces a three- The angle 6a is unconditionally determined by the angular 

dimensional image (distance image) by optically scanning 2* speed of deflection of slight light U. The light reception 
an object, and is one type of active measuring method for angle Bp is calculated from the relationship: tan 6p=b/yp. 
imaging an object illuminated by a specific light. The That is, the three-dimensional position of point P can be 
three-dimensional image is a collection of pixels represent- determined based on the angle 8a by measuring the position 
ing the three-dimensional positions of a plurality of parts on (xp,yp) on the imaging surface S2 

an object In the optical slit projection method the section of 30 When the light reception system is provided with a zoom 
a linear slit light is used as the detection tight. lens unit as shown in FIG. 47c, the principal point O 

FIGS. 46a, 46b, 46c, and 46d briefly show the optical slit I***™* the posterior side principal point If. When the 
projection method, and FIGS. 47a, 476, and 47c illustrate ^stance between the posterior side principal point H' and the 
the principles of measurement via the optical slit projection anterior side principal point H is designated M, the Z 

method. 35 coordinate of point P is expressed by the equation below. 

A section of object Q serving as a measurement subject is L*=Li+L2~zianQa+(Z-M)t!mQp 
illuminated by a thin band-like slit light U, and, the light 

reflected from the object Q impinges, for example, the .*.2KL+Aftanep)/(tanea-ManC^) 

imaging surface S2 of a two-dimensional image sensor Mn , , . . 

(FlT^). If the illuminated portion of object Q ! flat, the 40 ^S"™? ^T* ~" used winch compnses 

sensed image (slit image) is a straight line (FIG. 46ft). If the £ tinagmgstiife«S2 having a finite number of paek as m, 

illuminated portion^ nnevenTto straight tine becomes ^ mpk ' » 9°? ^ ?,^ k measul ™ ent 

curved and £p4ike (FIG. 46c). TTuVis/u* magnitude of ™ the prerously described sht hght projection metiiod, the 

the distance between the measuring device amilblobject Q M «u^m«t resolving power is dependent on the purel 

is reflected at the incident position of the reflected^ on 45 ^ ° f ^8 

imaging surface S2 (FIG. 4^. Three^hmensional po^on ^J^^^f^^J W 

sampling can be accomplished by scanning the ob£ct L- ^ °\ ^ . shl '** " - *? direction (scanning 

face on a range viewed from the Kghl^eption^de by ^^^P^ a P*™^ 1 P™* ™ imaging 

deflecting the slit light U perpeodicular to the length dircc- _„ -,, . .. ... , .. 

tion. The number ofpomts of tins sampling is dependent on 50 48 muStrates ** °* this measurement 

the number of pixels of the image sensor. m ^,„ " _ . .„ , 

■ ™>o « , "I . , . When the reflectivity of the illuminated portion of the 

In FIGS. 47a, 47ft, and 47c, the hght emitting system and object is assumed to be uniform, the intensity of the received 

light receiving system are positioned such that the base line light is a normal distribution expanding on the Y direction. 

AO connecting the origin A of the projection light and the S5 ff ^ effective intensity range of this normal distribution is 

principal point of the hght reception lens is perpendicular to a plurality of pixels, the maximum intensity position (i.e., 

the optical axis of received tight. The principal point of the barycenter) can be measured in units under the pixel pitch by 

lens is a point on the receiving optical; axis separated fiom interpolation of the amount of light received by each pixel 

the sensing surface S2 only by the so-called image distance g . This interpolation fits the normal distribution to the 

b when the image of an object at infinite distance is formed M amount of tight received by each pixel. The X, Y, and Z 

on imaging surface S2. The image distance b is the sum of coordinates are determined based on the barycenter deter- 

the focal length f of the light receiving system and the mined by ue aforesaid calculation. If this method is used, 

amount of tens extension tot focusing adjustment. Ae actual resolving power is 'A to Vio pixels. 

The principal point O is the origin of the three- When measuring via the slit light projection method, the 

dimensional orthogonal coordinates. The hght reception axis 65 person doing the measurement determine the position and 

is the Z axis, the base AO is the Y axis, and the slit light direction of the range finder, and sets the scanning range 

length direction is the X axis. When the slit Hght U illumi- (image sensing range) of the object Q via a zoom operation 



03/03/2004, EAST Version: 1.4.1 



US 6,529,280 Bl 

3 s 4 

as necessary. It is useful to display a monitor image of the tion data and individual parameters which make it impos- 

sensed object Q at the same field angle as the scanning range sible to perform simple calculations due to the extreme 

to easily accomplish the aforesaid framing operation. In complexity of error correction, and require a great deal of 

three-dimensional CG, for example, color information of the time for the calculation process. Thus, a further disadvan- 

object Q as well as measurement data expressing the shape 5 tage is the inclusion of many errors in the input data, which 

of the object Q are often required. make it impossible to perform accurate calculations. 

Conventional range finders have a spectral means (e.g., Although the framing which determines the scanning 

dichroic mirror) for separating the light transmitted through range of the object Q can be performed with a high degree 

the light-receiving lens system into slit light and environ- of freedom by providing a zooming mechanism in the 

mental light, and are constructed so as to produce a color 10 rangefinder as in conventional devices, disadvantages arise 

monitor image at the same field angle as the distance inasmuch as when zooming the principal point of the light 

information by directing the environmental light to a color receiving system is moved on the optical axis and causes 

image sensing means separate from the image sensing errors to occur in the triangular measurement 

means used for measurement (refer to Japanese Unexamined Furthermore, when the light receiving system is provided 

Patent Application No. SHO 7-74536). is with w zooming function, the imaging field angle changes 

If a dichroic mirror is used as the aforesaid spectral due to said zooming. Therefore, the width of the slit light on 

means, the entering light can be separated by wavelength the projection side must be adjusted in accordance with the 

virtually without decreasing the amount of light. zooming performed on the fight receiving side so as to 

In practice, however, there are no dichroic mirrors which introduce the maximum width slit light U onto the imaging 

have ideal wavelength selectivity for reflection or transmis- 20 surface S2. 

skra of only the slit light. Therefore, conventionally a Conventional devices are provided with a passive type 

disadvantage exists insofar as the environmental light distance sensor as a rangefinder which allows variable 

greatly affects measurements because light of a compara- imaging distances depending on mode of use. The range 

lively broad wavelength range including the slit light wave- measurement result is used in autof ocusing (AF), and setting 

length enters the image sensing means. 25 the projection light intensity. 

In order to increase the resolving power, the width (i.e., Ine aforesaid passive type distance sensor produce large 

length in the scanning direction) of the slit light may be errors due to lens focal length, subject contrast distribution 

increased by stages of projection light by setting the width and the like. In contrast, rangefinders are capable of active 

of the sht light of the image imaging surface S2 to a plurality type precision range measurement using a measurement- 

of pixels. Id so doing, the distribution of the intensity of the 30 specific optical system. Measurement conditions including 

received light doe snot form a normal distribution when the the autofocus lens position, and detection light projection 

illuminated portion (point P) is the border of an object color angle range can be finely adjusted to increase measurement 

because the width in the Y direction of the sht light broadens precision and improve measurement resolving power, 

on the object Q, thereby increasing measurement error. Furthermore, in the actual projection of the detection light 

In conventional devices, the projection light conditions 35 and measurement of the received light, passive type optical 

are set such that the sht width is as narrow as possible on the distance measurement and ultrasonic distance measurement 

object Q, and the width of the slit light U is broadened then differ such that distance information and reflectivity infor- 

impinges the imaging surface S2 by means of a filter or the ma tion of the object surface can be obtained as measurement 

like in the light reception system. environmental information. If reflectivity information is 

The narrowing of the width of slit light V is optically 40 used, it is possible to set more suitable light receiving 
limited, however. The illumination range (slit width) on conditions (e.g., amount of projection light, light reception 
object Q broadens as the distance increases from the starting sensitivity and the like) compared to simply changing set 
point A of the projection tight Accordingly, conventional values in accordance with distance, 
devices are disadvantageous inasmuch as the measurement When optical scanning identical to the measurement time 
distance (distance between the measuring device and the 45 is accomplished as a preliminary measurement before the 
object 0) at which measurement of a specific precision is main measurement, however, the specific time of the opera- 
possible is short regardless of the distribution of the reflec- tion combining the preliminary measurement and the mea- 
tivity of the object Q. surement following thereafter, Le., the measurement time of 

In conventional devices, the mutual positional relation- one cycle, becomes longer. When the calculation of the 

ship between the light projecting device comprising the 50 preliminary measurement is performed relative to the sam- 

projection system and the device comprising the light pling points of the entirety of the image sensing range, the 

receiving system is fixed, such that the constructions do not amount of said calculation is extensive, such that the specific 

allow adjustment of the respective optical axes, not center time of the r^liminary measurement becomes longer, 

axis fine and scan direction. In conventional devices, a passive type cK^n"* sensor is 

Therefore, in conventional three-dimensional input 55 provided in a rangefinder capable of variable imaging dis- 
cameras, twisting occurs among the mutual optical axes, tances according to the mode of use. The distance measure- 
center line axes, and scanning direction of the light projec- ment result is used to set the autofocus (AF) and projection 
tion device and light receiving device, such that said axes are fight intensity. 

not in the same plane and errors arise in the mutual posi- Even when the projection light intensity is adjusted in 

tional relationships. These errors also occur in three- 60 accordance with the distance measurement result, the 

dimensional input cameras using a zoom lens, but these amount of received light of the detection light is reduced to 

errors can be corrected with relatively easily based on less than a lower limit when the reflectivity of the object 

calculations using correction data obtained by imaging. surface is too low, such that suitable measurement results 

When a three-dimensional input camera is provided with cannot be obtained Thus, suitable final measurement results 

a zoom lens, however, correction data differ in accordance 65 cannot be obtained when the amount of received light 

with the amount of operation and movement of the zoom exceeds a lower limit due to positive reflectivity of the object 

lens, such that there are extremely large amounts of correc- surface and the introduction of environmental light. 
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Furthermore, the measurement error increases when mea- 
surement distance range set based on the measurement result 
is outside possible measurement. 

Conventionally, when measurement parameters such as 
reflectivity, distance-to-object, measurement range and the 
like are unsuitably set, a user will invariably judge that 
suitable measurement has been accomplished the measure- 
ment operation is completed regardless of whether or not a 
suitable measurement result can actually be obtained. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an 
improved three-dimensional measuring device and three- 
dimensional measuring method. 

Another object of the present invention i to provide a 
spectral device capable of producing a monitor image hav- 
ing the same field angle as the distance image and capable 
of realizing three-dimensional measurement only slightly 
influenced by environmental light, and a three-dimensional 
measuring device for use in said spectral device. 

Another object of the present invention is to realize a 
three-dimensional measuring device which allows a great 
degree of freedom in setting measurement distances, and is 
capable of high precision measurement at high resolving 
power when the reflectivity of an object is nonuniform with 
effectiveness similar to when said reflectivity is uniform. 

Yet another object of the present invention is to provide a 
three-dimensional input camera capable of eliminating error 
in the positional relationship between the light projecting 30 
device and the light receiving device, and capable of accu- 
rate measurement with minimal error when a zoom lens is 
installed. 

A further object of the present invention is to provide a 
measuring device having excellent practicality with minimal 35 
measurement error and minimal restrictions on imaging 
position setting. 

, A still further object of the present invention is to provide 
a compact light projection device capable of emitting dis- 
tortionless slit light and which allows adjustment of the slit 40 
width, and a three-dimensional measuring device utilizing 
said right projection device. 

An even further object of the present invention is to 
realize high-speed and high-precision three-dimensional 
measurement by effectively measuring the measurement 
environment relating to the measurement parameter settings. 

Yet another object of the present invention is to provide a 
three-dimensional measuring device capable of performing 
suitable operation by allowing a user to confirm the unsuit- 
ability of measurement conditions before and after measure- 
ment 

... These objects and other objects are achieved by providing 
a three-dimensional measuring device comprising: 

an optical projection system winch illuminates an object 

with tight or specific wavelength; and 
an optical reception system which receives light reflected 
by the object, said optical reception system including; 
a spectral means for separating the light of a predeter- 
mined wavelength range including said specific 
wavelength into light of another wavelength range, 
and 

a filtering means provided on the optical path of the 
light of said predetermined wavelength range sepa- 
rated by said spectral means, said filtering means 
blocking from among the light within said predeter- 
mined wavelength range, light which is of a wave- 



length longer than said specific wavelength and light 
which is of a wavelength shorter than said specific 
wavelength. 

These objects and other objects are achieved by providing 
a three-dimensional measuring method comprising steps of: 

illuminating an object with light of specific wavelength; 

dividing the light reflected by the object into a first light 
of a wavelength range including said specific wave- 
length and a second light of another wavelength range; 

cutting from the divided first light, light which is of a 
wavelength longer than said specific wavelength and 
light which is of a wavelength shorter than said specific 
wavelength, to obtain the light of the specific wave- 
length; and 

sensing said obtained light of the specific wavelength for 
three-dimensional measuring. 

These objects and other objects are achieved by providing 
a three-dimensional measuring device comprising: 

an optical projection system which sequentially illumi- 
nates an object with light at variable illumination 
angles; 

an image sensor which periodically samples the light 
reflected by the object synchronously with the variation 
of illumination angle of said optical projection system; 
and 

a first calculation means for calculating the illumination 
timing of maximum light reception by said image 
sensor based on a maximum sampling value obtained 
by said image sensor, and the sampling values of the 
sampling cycles one cycle before and one cycle after 
the sampling cycle which obtained said maximum 
value for measuring a three-dimensional position of the 
ooject. 

These objects and other objects are achieved by providing 
a three-dimensional measuring method comprising steps of: 
sequentially illuminating an object with light at variable 

illumination angles; 
receiving the light reflected by the object on an image 
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periodically sampling the received light synchronously 
with the variation of flhurrination angle by the image 
sensor; and 

calculating the illumination timing of maximum light 
reception by said image sensor based on a maximum 
sampling value obtained by said image sensor, and the 
sampling values of the sampling cycles one cycle 
before and one cycle after the sampling cycle which 
obtained said maximum value for measuring a three- 
dimensional position of the object 

These objects and other objects are achieved by providing 
a three-dimensional measuring device comprising: 

an optical projection system which illuminates an object; 

an optical reception system which receives light reflected 
by the object illuminated by said optical projection 
system; and 

an adjustment mechanism for adjusting the relative posi- 
tions of said optical projection system and said optical 
reception system, said adjustment mechanism main- 
! taming said projection system and said reception sys- 
tem so as to be relatively rotatable on a first rotational 
axis along the optical axis of said reception system and 
a second rotational axis perpendicular to said first 
rotational axis. 
These objects and other objects are achieved by providing 
a three-dimensional measuring device comprising: 
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an optical projection system which illuminates an object 
with light beam; 

an image sensor which outputs image signals correspond- 
ing to the amount of light impinging the image sensing 
surface; 

an optical reception system which forms an optical image 
of the object on the image sensing surface of said image 
sensor; 

a detection means for detecting the principal point posi- 
tion of said optical reception means; and 

a calculation means for calculating a three-dimensional 
position of the object based on the principal point 
position detected by said detection means and the 
image signals of the object obtained by said image 
sensor. 

These objects and other objects are achieved by providing 
three-dimensional measuring method comprising steps of: 
illuminating an object with light beam; 
forming an optical image of the object on an image 

sensing surface of an image sensor by an optical 

reception system; 
outputting image signals corresponding to the amount of 

light impinging the image sensing surface; 
detecting the principal point position of said optical 

reception system; and 
calculating a three-dimensional position of the object 

based on the detected principal point position and the 

image signals. 

These objects and other objects are achieved by providing 
three-dimensional measuring device comprising: 
an optical projection system which illuminates an object 
with light; 

an image sensor winch outputs image signals correspond- 
ing to the amount of light impinging the image sensing 
surface; 

an optical reception system for forming an optical image 
of the object on the image sensing surface of said image 
sensor via light emitted said optical projection system 
and reflected by the object; 

a preliminary measurement control means for executing a 
preliminary measurement by making said optical pro- 
jection system and said image sensor operate prior to an 
actual three-dimensional measurement to obtain infor- 
mation on the distance to the object based on the image 
signals of the object imaged by said image sensor, and 

a actual measurement control means for setting a mea- 
surement condition in accordance with the distance 
information obtained by said preliminary measurement 
and for executing the actual measurement by making 
said optical projection system and said image sensor 
operate under the set measurement condition to actually 
measure the three-dimensional position of the object 

These objects and other objects are achieved by providing 

three-dimensional measuring method comprising steps of: 

illuminating an object with light; 

forming an optical image of the illuminated object on an 
image sensing surface of an image sensor; 

outputting image signals corresponding to the amount of 
light impinging the image sensing surface; 

obtaining information on the distance to the object based 
on the reflection light from said object imaged by said 
image sensor prior to an actual measurement of the 
three-dimensional position of the object; 

setting a measurement condition in accordance with the 
obtained distance information; and 
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executing the actual measurement of the three- 
dimensional position of the object under said set mea- 
surement condition. 
These objects and other objects are achieved by providing 
5 a three-dimensional measuring device comprising: 

an optical projection system which projects light on an 
object with varying the projection angle within a pre- 
determined range of projection angles; 
an image sensor which receives light reflected from the 
object illuminated by said projection system and gen- 
erating image signals of the object; 
a preliminary measurement control means for executing a 
preliminary measurement by making said optical pro- 
l5 jection system operate within only a part of the prede- 
termined projection angle range prior to actual three- 
dimensional position measurement and by driving said 
image sensor to generate the image signals; and 
a actual measurement control means for setting a mea- 
surement condition in accordance with the image sig- 
nals obtained by said preliminary measurement and for 
controlling said optical projection system and said 
image sensor to execute the actual measurement under 
the set measurement condition. 
25 These objects and other objects are achieved by providing 
a three-dimensional measuring method comprising steps of: 
executing a preliminary measurement which includes 
steps of projecting light on an object with varying the 
projection angle within a narrow predetermined range 
30 of projection angles, sensing the light reflected from the 
illuminated object, and generating image signals of the 
object; 

setting a measurement condition in accordance with the 
image signals obtained by said sensing step; and 
35 executing, under said measurement condition set by said 
setting step, an actual three-dimensional measurement 
which includes steps of projecting light on the object 
with varying the projection angle within a wide prede- 
termined range of projection angles, sensing the light 
40 reflected from the illuminated object, and generating 
image signals of the object 
These objects and other objects are achieved by providing 
a three-dimensional measuring device comprising: 
an optical projection system which projects light on an 
45 object with varying the projection angle; 

an image sensor which receives light reflected from the 
object illuminated by said projection system and gen- 
erating image signals of the object; 
a preliminary measurement control means for executing a 
preliminary measurement prior to an actual measure- 
ment by making said optical projection system and said 

. . image sensor operate; 

a setting means for setting a measurement condition for 
55 the actual measurement in accordance with a part of the 
image signals obtained by said preliminary measure- 
ment; 

an actual measurement control means for executing the 
actual measurement under said set measurement con- 
60 ctition by making said optical projection system and 
said image sensor operate; and 
a calculating means for calculating three-dimensional 
positions of the object in accordance with entire image 
signals obtained by said actual measurement. 
65 These objects and other objects are achieved by providing 
a three-dimensional measuring device which projects light 
on an object and senses the light reflected by said object 
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under variable measurement conditions to obtain three- FIGS. 14a and 14b illustrate the principle of detecting 

dimensional positions of the object, said three-dimensional three-dimensional positions in the measurement system; 

measuring method comprising; FIG. 15 is a block diagram of the output process circuit; 

a judging means for judging whether said measurement FIG. 16 shows the reading range of the image sensor, 

conditions are acceptable or not; and 5 FIG. 17 is a block diagram of the warning discrimination 

a warning means for warning if said judging means judges circuit; 

that saa ^ea^^ntconditions are not acceptable. FIG. 18 shows the relationship between input and output 

Tbese objects and other objects are achieved by providing of a* warning discrimination circuit; 
a three-dimensional measuring device which projects light 

on an object and senses the light reflected by said object 10 FIG 19 the date flow in the three-dimensional 

under variable measurement conditions to obtain infonna- camera; 

tion related to three^hmensional positions of the object, said FIG. 20 shows the data flow in the host; 

three-dimensional measuring method comprising; FIG. 21 shows the positional relationship between the 

a display on which displays the obtained information; 15 object and each point of the optical system; 

a judging means forjudging the obtained information are FIGS. 22a, 22b, and 22c illustrate the sequence of opti- 

acceptable or not; and mizing the projection light intensity; 

a control means which displays the unacceptable infor- nG 23 sampling range during preliminary 

iiiation in different shape from the acceptable infonna- measurement; 

tion on said display. 20 FIGS. 24a and 24b show the relationship between the slit 
These objects and other objects are achieved by providing image and the sampling point; 
a optical system used in three-dimensional measurement FIG. 25 shows the data content of a preliminary measure- 
apparatus which measures three-dimensional positions of an ment table; 

object, said optical system comprising an optical projection FIGS. 26a and 26b are graphs showing typical examples 

device which includes: 25 Q f the relationship between the projection light intensity and 

a light source which emits light beam therefrom; the amount of received light; 

a variator which is provided on a path of said light beam FIG. 27 is a graph showing the optimum intensities 

emitted by light source and varies diameter of the light relative to FIGS. 26a and 26b; 

beam; ^ FIG. 28 shows a measurement example illustrating the 
an expander which is provided on a path of the light beam preview function; 
varied by said variator and expand the light beam in one FIGS. 29a and 29b show modifications of the measure- 
direction to form a slit light beam; and ment conditions; 
a deflector which deflects said sHt light beam formed by FIGS. 30a and 30b show contents of the monitor display 

said expander. 35 relative to FIGS. 29a and 29b; 

these and other objects, advantages and features of the FIG. 31 is a main flow chart showing the sequence of 

invention will become apparent from the following descrip- controls executed by the system controller, 

tion thereof taken in conjunction with the accompanying FIG. 32 is a flow chart showing a subroutine of prelimi- 

drawmgs which illustrate specific embodiments of the nary measurement of FIG. 31; 

invention. 40 FIG. 33 is a flow chart showing a subroutine of setting the 

BRIEF DESCRIPTION OF THE DRAWINGS conditions for preliminary measurement of FIG. 32; 

__, _ _ . FIG. 34 is a flowchart showing a subroutine of environ- 

FIG. 1 shows the construction of the measurement system mcnUl ^ of HG . 33. 

o present invention; FIG. 35 is a flow chart showing a subroutine slit image 

FIGS. 2a and 2b show exterior views of the three- 45 sensing of FIG. 32; 
dimensional camera; FIG. 36 is a flow chart showing a subroutine of sampling 

FIG. 3 is a block diagram showing the functional con- with intensity A of FIG. 35; 
struction of the three-dimeiisional camera; FIG. 37 is a flow chart showing a subroutine of sampling 

FIGS. 4a and 4b show the construction of the optical 5Q with intensity B of FIG. 35; 
projection system; FIG. 38 is a flow chart showing a subroutine of imaging 

FIG. 5 shows the zoom unit of the light receiving system; information discriminated as unsuitable of FIG. 32: 

FIG. 6 shows a- beam sputter; - FIG: 39 is a flow chart showmg a subroutine of distance 

FIG. 7 is a graph showing the wavelength of the light calculation of FIG. 32; 

received by the image sensor used for measurement; 55 FIG. 40 is a flow chart showmg a subroutine of setting the 

FIG. 8 is a graph showing the wavelength of the light conditions for main measurement of FIG. 32; 
received by color sensor of the monitor, fig. 41 is a flow chart showing a subroutine of setting the 

FIG. 9 is a perspective view of the dual axis adjustment intensity of the projection light of FIG. 40; 

mechanism of the optical unit; ^ FIG. 42 is a flow chart showing a subroutine of the main 

FIG. 10 is an elevation view of the top portion of the measurement of FIG. 31; 
optical unit of FIG. 9; FIG. 43 is a flow chart showmg a subroutine of the 

FIG. U is a side view of the top portion of the optical unit remeasurement process of FIG. 31; 
of FIG. 9; FIG. 44 is a timing chart showing an example of syn- 

FIG. 12 is a bottom view of the optical unit of FIG. 9; 55 chronous control of the galvano mirror and image sensor; 

FIGS. 13a and 13b illustrate the adjustment method of the FIG. 45 is a tuning chart showing another example of 

dual axis adjustment mechanism of the optical unit; synchronous control of the galvano mirror and image sensor; 
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FIGS. 46a, 46£, 46c, and 46J briefly show the slit analog output pin 32 may be, for example, NTSC type 
projection method; (National Television System Committee) signals. Digital 

FIGS. 47a, 476, and 47c illustrate the principles of output pin 33 is, for example, an SCSI (Small Computer 
measurement via the slit projection method; System Interface) pin. 

FIG. 48 illustrates the principle of a conventional mea- 5 2 * 2 * Three-dimensional Camera 2 Control Circuit 
surement method. nG - 3 » a Dlock diagram showing the functional con- 

In the following description, like parts are designated by ^ tion of ^e^iimensional camera 2. In the drawing, the 
like reference numbers throughout the several drawings. f b ^ rrow «*««»»» ^ flow of electric signals, and the 

dashed arrow represents the flow of light. 
DETAILED DESCRIPTION OF THE to Three-dimensional camera 2 is provided with two optical 

PREFERRED EMBODIMENTS units 40 and 50 disposed on the projection side and reception 

1. Overall Construction of Measurement System 1 side, respectively, and which together comprise the previ- 
FIG. 1 shows the construction of measuring system 1 of ously mentioned optical unit OU. In projection optical unit 

the present invention. 40 a semiconductor laser (LD) 41 emits a laser beam having 

Measuring system 1 comprises a three-dimensional cam- is a wavelength of 690 nm which becomes slit light U after 
era (rangefinder) 2 for accomplishing stereoscopic measure- passing through the projection lens unit 42, and is then 
ment by a slit projection method, and host 3 for processing deflected in a direction perpendicular to the length direction 
data output from said three-dimensional camera 2. of the slit via gafvano mirror (scanner) 43. The driver 44 for 

Three-dimensional camera 2 outputs measurement data semiconductor laser 41, drive system 45 for projection lens 
(slit image data) specifying the three-dimensional positions 20 unit 42, and drive system 46 for galvano mirror 43 are all 
of a plurality of sampling points on object Q, as well as controlled by a system controller 61. 
two-dimensional image data expressing color information of In reception optical unit 50, light condensed by zoom unit 
object Q and data required for calibration. The calculation 51 is split by beam splitter 52. The light in the oscillation 
process for determining coordinates of sampling points wavelength range of semiconductor laser 41 enters the 
using a triangulation method is accomplished by host 3. 25 image sensor 53 used for measurement. Light in the visible 
Host 3 is a computer system comprising a central pro- range enters the color image sensor 54 used for monitoring, 
cessing unit (CPU) 3a, display 3b, keyboard 3c, and mouse Either or both the image sensor 53 and color image sensor 
3d. software for processing measurement data is included in 54 may be a charge-coupled device (CCD) area sensor. 
CPU 3a. Data transfers between host 3 and three- Zoom unit 51 is an internal focus type, and a part of the 
dimensional camera 2 are possible in both online mode and 30 incident light is used for auto focusing (AF). The auto focus 
offline mode by portable recording media. These recording function is realized by AF sensor 57, lens controller 58, and 
media include magneto-optic disk (MO% mini disk (MD), focusing drive system 59. The zoom drive system 60 is 
memory card and the Uke. provided for electric zooming. 

2. Construction of Three-dimensional Camera 2 Imaging information obtained by image sensor 53 is 
2-1. Three-dimensional Camera 2 Exterior View 35 synchronized by clock signals from driver 55, and transmit- 

FIG. 2a is a perspective view showing the exterior of ted to output process circuit 62. Measurement data Ds 
three-dimensional camera 2, and FIG. 26 is a plan view of corresponding to each pixel output by image sensor 53 are 
the operational panel provided at the back of three- generated by the output process circuit 62, and temporarily 
dimensional camera 2. stored in memory within said output process circuit 62. On 

A projection window 20a and reception window 206 are 40 the other hand, imaging information obtained by color 
provided on the front surface of housing 20. Projection image sensor 54 is synchronized by clock signals from 
window 20a is positioned above the reception window 20b. driver 56 and transmitted to color process circuit 67. The 
Slit light (band-like laser beam of predetermined width w) U imaging information subjected to color processing is output 
is emitted from an internal optical unit OU through projec- online through NTSC conversion circuit 70 and analog 
tion window 20a toward an object which is the subject of 45 output pin 32, or quantized by digital image generator 68 
measurement. The radiation angle $ of slit light U in the and stored in color image memory 69. 
width direction Ml is fixed. A portion of the slit light U Output process circuit 62 generates distance image data 
reflected by the object surface passes through reception representing the measurement result based on the measure- 
window 206 and enters optical unit OU. Optical unit OU is ment data Ds, and outputs said data to multiplexor 72. 
provided with a dual axis adjustment mechanism to optimize 50 Multiplexor 72 selects as output one of the two input color 
the relative position relationship between the projection light image data, Le., distance image data D21 or color image data 
axis and the reception light axis. This mechanism is D22 from color image memory 69, in accordance with the 
described in detail later. ~ - v instructions from system controller 61 . The data selected by 

On the top panel of housing 20 are provided zoom buttons multiplexor 72 is transmitted via digital-to-analog (D/A) 
25a and 256, manual focus buttons 26a and 266, and release 55 converter 73 to the character generator 71 as analog monitor 
button 27. As shown in FIG. 26, on the back panel of display signals. Character generator 71 combines the image 
housing 20 are provided a liquid crystal display 21, cursor expressed by the monitor display signals and text and 
button 22, selection button 23, cancel button 24, record symbols specified by system controller 61, and outputs the 
button 28, undo button 29, analog output pins 31 and 32, composite image to liquid crystal display 21. 
digital output pin 33, and removable recording media instal- 60 When a user operates the record button 28 to specify data 
lation slot 30a. Record button 28 also functions as a focus output (image recording), the measurement data Ds within 
locking button. the output process circuit 62 are either output online in 

Liquid crystal display 21 is used as an operation screen predetermined format by either SCSI controller 66 or NTSC 
display means and as an electronic finder. An operator can conversion circuit 65, or stored on recording medium 4. The 
set the image sensing mode via the various buttons on the 65 analog output pin 31 or digital output pin 33 is used for 
back panel. Measurement data are output from analog output online output of measurement data Ds. The color image data 
pin 31; the two-dimensional image signals output from D22 is transmitted from color image memory 69 to SCSI 
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controller 66, and output online from digital output pin 33, FIG. 8 is a graph showing the reception light wavelength of 

or stored on recording medium 4 associated with measure- the color sensor 54 used for monitoring, 

ment data Ds. The color image is an image having the same Beam splitter 52 comprises a color separation film 

field angle as the distance image obtained by image sensor (dichroic mirror) 521, two prisms 522 and 523 cucumscrib- 

53, and is used as reference information for the application 5 ing color separation layer 521 therebetween, infrared cutting 

processing performed by host 3. Processes using the color filter 524 provided on the emission face 522b of prism 522, 

information include, for example, a process for incorporate visible light cutting filter 525 provided on the anterior face 

ing a plurality of pairs of measurement data of different of image sensor 53, infrared cutting filter 526 provided on 

camera perspectives to generate three-dimensional models, emission face 5236 of prism 523, and low-pass filters 527 
and a process for culling unnecessary items from three- 10 and 528. 

dimensional models. The incident light UC from zoom lens 51 passes through 

System controller 61 generates audible warning signals low-pass filter 527 and prism 522, and impinges color 

and operation verification signals by actuating a buzzer 75. separation layer 521. The light OU at the oscillation wave- 

A scale value sc for the monitor display is supplied to output length of semiconductor laser 41 is reflected by the color 
process circuit 62. Output process circuit 62 outputs three 15 separation layer 521, and after reflection by the incident 

types of warning signals Sll, S12, and S13 (described later), surface 522a of prism 522, is emitted toward image sensor 

and light reception signals Dg which are a part of the 53. Within the light OU emitted from prism 522, the light 

measurement data Ds, and transmit said signals to system passing through infrared cutting filter 524 and visible light 

controller 61. cutting filter is received by image sensor 53. On the other 
2-3. Construction of Optical Projection Unit 40 of Three- 20 hand, the light CO that has passed through color separation 

dimensional Camera 2 layer 521 passes through prism 523, and is emitted from the 

FIGS. 4a and 4b show the construction of optical projec- emission panel 5236 toward color sensor 54. Within the light 

tion unit 40. FIG. 4a is a front view, and FIG. 4b is a side CO emitted from prism 523, the fight passing through 

view. infrared cutting filter 526 and low-pass filter 528 is received 

Projection lens 42 comprises three lenses which include 25 by color sensor 54. 
collimator lens 421, variator lens 422, and expander lens In FIG. 7, the color separation layer 521 indicated by the 
423. Optical processing to obtain a suitable slit light U is dashed line reflects light within a relatively broad wave- 
performed in the sequence described below on the laser length range which includes the slit fight wavelength (k: 690 
beam emitted from semiconductor laser 41. First, the mean did). That is, The wavelength selectability of the color 
is oollimated by collimator lens 421. Then, the laser beam 30 separation layer 521 is inadequate when only the slit light is 
diameter is adjusted by variator lens 422. Finally, the beam selectively incident to the image sensor 53. Since the beam 
is expanded in the slit length direction Ml via expander lens splitter 52 is provided with the infrared cutting filter 524 
423. having the characteristics indicated by the dashed line, and 

Variator lens 422 is provided to direct the slit tight U visible light cutting filter 525 having the characteristics 

having a width of three or more pixels (five pixels in the 35 indicated by the solid line, the light ultimately incident to 

present embodiment) onto image sensor 53. Drive system 45 image sensor 53 is tight of a wavelength within a narrow 

moves variator lens 422 so as to maintain a constant width range indicated by the shaded area in FIG. 7. Therefore, 

w of slit light U on image sensor 53 in accordance with measurement can be realized with scant influence of envi- 

instructions from system controller 61. Variator lens 422 and ronmental light, Le., with a large optical SN ratio, 

the reception side zoom unit 51 are connected. 40 On the other hand, only visible light enters color sensor 54 

Expanding the slit length prior to deflection by galvano because light in the infrared range passing through the color 

mirror 43 reduces distortion of slit light U compared to said separation filter 521 having the characteristics indicated by 

expansion after deflection. The galvano mirror 43 can be the dashed line is blocked by infrared cutting filter 528 

rendered in a more compact form factor by disposing the having the characteristics indicated by the solid line in FIG. 

expander lens 423 in the final stage of the projection lens 45 8. Thus, color reproducibility of the monitor image is 

system 42, Le., nearer to galvano mirror 43. increased. 

2-4. Construction of the Optical Reception System 50 of A single filter having characteristics for blocking both 

Three-dimensional Camera 2 infrared and visible light may be used instead of the two 

FIG. 5 shows the zoom unit 51 of the optical reception filters of infrared cutting filter 524 and visible tight cutting 

system 50. 50 filter 525. Both infrared cutting filter 524 and visible light 

Zoom unit 51 comprises front image forming lens 515, cutting filter 525 may be disposed on the prism 522 side, or, 

variator lens 514, compensator lens 513, focusing lens 512, conversely, both said filters may be disposed on the image 

rear image forrning lens -511, and beam splitter 516 for sensor 53 side. Conversely to the example shown in HG. 6, - 

guiding a part of the incident light to AF sensor 57. The front the visible light cutting filter 525 may be disposed on the 

image forming lens 515 and rear image forming lens 511 are 55 prism 522 side, and infrared cutting filter 524 may be 

fixed relative to the optical axis. disposed on the image sensor 53 side. 

The movement of focusing lens 512 is accomplished by 2-5. Dual axis Adjustment Mechanism of Optical Unit OU 

focusing drive system 59, and the movement of variator lens of Three-dimensional Camera 2 

514 is accomplished by zooming drive system 60. The The dual axis adjustment mechanism of optical unit OU 

focusing drive system 59 is provided with a focusing 60 is described below. 

encoder 59A for specifying the travel distance (feed amount) FIG. 9 is a perspective view briefly describing the dual 

of focusing lens 512. Zooming drive system 60 is provided axis adjustment mechanism of optical unit OU. FIG. 10 is a 

with a zooming encoder 60A for specifying the movement frontal perspective of the top part of the optical unit OU of 

distance (zoom value) of variator lens 514. FIG. 9 as viewed from the arrow KA direction. FIG. 11 is a 

FIG. 6 shows beam splitter 52 of the optical reception 65 right side view of the top part of the optical unit OU of FIG. 

system 50. FIG. 7 is a graph showing the reception light 9 as viewed from the arrow KB direction. FIG. 12 is a 

wavelength of the image sensor 53 used for measurement bottom view of the optical unit OU of FIG. 9 as viewed from 
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the arrow KC direction. FIGS. 13a and 136 illustrate the The screen SCR shown in FIG. 13a is arranged perpen- 

adjustment method of the dual axis adjustment mechanism dicular to the light receiving axis AX3 in the front of 

of optical unit OU. receiving axis AX3. First, in regard to the slit light U 

As shown in FIG. 9, optical unit OU comprises optical projected onto screen SCR from the projection system 40, 

projection system 40 as a projection device, and optical 5 when the slit light U is scanning, the relative positions of 

reception ^system 50 as a] light receiving device, mounted on bracket 211 and bracket 212 are adjusted relative to second 

brackets 211 and 212. These two brackets 211 and 212 are rotatioil axis AX2 so as to mutually align the right and left 

connected so as to be mutoally rotatableabout a second ^ ALA and AL2 of slit light U so as to be 

rotationaxis AX2 on the Y dnxcton axis. Optical section mutualI identical before and after the scan. Hien, in regard 

system 40 is mounted on bracket 211 so as to be rota table _ # .« . . 1T . . , . ™ 

i t m R . ... . AV1 rj . ~ .. , 10 to the sht light U received on imaging surface S2 shown in 

about a first rotation axis AX1 on the Z axis. Optical ~z r . 

reception system 50 is fixedly mounted on bracket 212. The n , G . J 08111011 of Projection system 40 is adjusted 

first rotation axis AX1 is adjusted so as to be parallel to the relaUve to the first rotation axis AX1 so as to mutually align 

light reception axis AX3 of optical reception system 50. me ri S ht **** left positions BL1 and BL2 so as to be mutually 

As shown in FIGS. 9 through 12, brackets 211 and 212 identical, Le., so as to render slit light U parallel to the X axis 

form an L-shaped conFiguration when viewed from the side, 15 °f imaging surface S2. These adjustments are repeated a 

and are rota table when in mutual contact when the exterior number of times. 

surface of horizontal panels 211a and 212a. That is, a collar The first rotation axis AX1 is rendered parallel to the 

216 is inserted in hole 215 provided on horizontal panel reception axis AX3 via the aforesaid adjustments, such that 

212a, and said collar 216 is fixedly attached to horizontal the scanning direction (deflection direction) of slit light U 

panel 211a via bolt 217. The bead of bolt 217 is provided 20 matches the direction of the second rotation axis AX2. 

with a tapped hole, and after the bead of bolt 217 is covered Therefore, there are no errors in the positional relationship 

with a closed ended cap (not shown in the drawing), which between projection system 40 and reception system 50, and 

is attached to bolt 217 by the bolt screwed into the tapped precise measurement can be accomplished without correc- 

hole on the head of the bolt through a hole provided in the tion of errors in said positional relationship. Even when 

center of the cap, thereby protecting the bead of bolt 217. A 25 performing correction to obtain even higher precision, 

channel used for a rotating connection is provided on the changing the correction value when zooming by the zoom 

head of bolt 217. unit 51 is unnecessary. Accordingly, calculation processes to 

An adjustment bolt 219 for adjusting the rotation angle achieve such correction is unnecessary or minimal with an 

position is screwed into the threaded hole provided on the extremely short processing time. 

protruding endpiece 219 of horizontal panel 212a. The tip of 30 3. Measurement of Three-dimensional Position by Measur- 

adj ustment boh 219 abuts the exterior surface of collar 222 ing System 1 

mounted on horizontal panel 211a via bolt 221. A tension 3-1. Principles for Calculating Three-dimensional Position 

spring 224 is installed between bolt 221 and bolt 223 FIGS. 14a and 146 illustrate the principle of calculating 

mounted on horizontal panel 212a, thereby mutually exert- a three-dimensional position by measuring system 1. 

ing force between horizontal panels 2Ua and 212a in the 35 The object Q is illuminated by a slit light U having a 

direction in which the tip of adjustment bolt 210 abuts collar relatively broad width of a plurality of pixels on the imaging 

222. Accordingly, the relative rotation angle position is surface S2 of image sensor 53. Specifically, the width of slit 

adjusted between bracket 211 and bracket 212 about the light U is set at five pixels. Slit light U is deflected from top 

second rotation axis by adjusting the axial direction position to bottom so as to move only the pitch pv of a single pixel 

by rotating the adjustment bolt 219. After the adjustment is 40 on the imaging surface S2 each sampling cycle, and thereby 

made by adjustment bolt 219, the adjustment bolt 219 is scan object Q. Photoelectric conversion information of 

locked in place with a lock nut 220, and both horizontal 1 -frame is output from image sensor 53 each sampling cycle, 

panels 211a and 212a are anchored by tightening three bolts When targeting a single pixel g on imaging surface S2, 

226 inserted through three slots 225 provided in horizontal effective reception data are obtain in five sampling cycles 

panel 212a and screwed into threaded holes in horizontal 45 among the N sampling cycles performed during scanning, 

panel 211a. The timing (time center Npeak: moment of the maximum 

A shaft member 231 is mounted on the back panel of the amount of received light of target pixel g) wherein the object 

housing of the optical projection system 40, and this shaft surface ag in the influence range of target pixel gpasses the 

member 231 is inserted, so as to be rotatable, in the center optical axis of slit light U is determined via interpolation of 

of first rotation axis AX1 in the perpendicular portion of so light reception data of the aforesaid five cycles. In the 

bracket 211. After adjusting the rotation angle position of example of FIG. 146, the amount of received light is greatest 

optical projection system 40 to center first rotation axis AX1, at a timing between the nth cycle and one cycle previous 

the optical projection system 40 is fixed to bracket 211 by (n-1). The position (coordinates) of object Q is calculated* 

tightening a plurality of bolts (not illustrated) passing based on the relationship between the incident direction of 

through holes provided in the housing of projection system 55 the slit light relative to the target pixel g and the projection 

40 and screwed into threaded holes provided in bracket 211. direction of the slit light by the determined timing. Thus, it 

A mounting plate 213 is attached to bracket 212 by bolts, and is possible to measure at higher resolving power than the 

a mounting plate 213 is attached to the casing of optical unit resolving power specified by the pixel pitch pv of the 

OU. imaging surface. 

The base line AO connecting the origin point A of the 60 The amount of reception light by target pixel g is depen- 

projection light in the optical projection system 40 and the dent on the reflectivity of object Q. The relative percentage 

principal point O (posterior side principal point H) of the of each quantity of reception light of the five sampling 

lens of optical reception system 50 is perpendicular to the cycles is constant regardless of the absolute value of the 

light receiving axis AX3. The imaging surface S2 is per- amount of reception light That is, the variable density of the 

peodicular to the refracted light receiving axis AX3. 65 object colors does not influence the measurement accuracy. 

The adjustment method for adjusting the first rotation axis In the measurement system 1 of the present embodiment, 

AX1 and second rotation axis AX2 is described hereinafter. light reception data of five cycles for each pixel g of image 
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sensor 53 of three-dimensional camera 2 are output to host output of the AD converter 622 and outputs of frame delay 

3, and said host 3 calculates the coordinates of object Q memories 623 through 626 at that moment when the delayed 

based on said measurement data. The generation of mea- light reception data Dg (output from frame delay memory 

surement data relative to each pixel g in three-dimensional 624) exceeds a maximum vafue, are stored in memories 

camera 2 is accomplished by output process circuit 62. 5 630A through 630E, respectively, thereby rewriting the 

3-2. Construction of Output Process Circuit 62 for Calcu- contents of said memories 630A through 630E. At the same 

la ting Three-dimensional Position time, the frame numbers FN corresponding to the light 

FIG. 15 is a block diagram of output process circuit 62. reception data Dg stored in memory 630C are stored in 

FIG. 16 shows the reading range of image sensor 53. memory 630F. The frame number FN is not the line number 

Output process circuit 62 comprises a clock signal gen- 10 (pixel number in the Y direction) through the entire imaging 

crating circuit 620 which outputs clock signal CK, amplifier surface S2, but rather the line number within the effective 

621 for optimizing the level of the photoelectric conversion reception area Ae having a width of 32 pixels, and is a value 
signal output from image sensor 53, AD converter 622 for in a range of 0 to 31. The line number in the entire imaging 
converting the photoelectric conversion signal of each pixel surface S2 can be specified by the frame number FN and the 
g to 8-bit reception data Dg synchronously with clock signal 15 sequence (i.e., the position of the target pixel g in the Y 
CK, four frame delay memories 623 through 626 connected direction) of reading the 32 lines. 

in series, comparator 627, generator 528 for specifying When the amount of received light of target pixel g at the 
frame number (sampling number) FN, multiplexor 629, six nth line is greatest, the data of the line (n+2) are stored in 
individual memories 630A through 630F, Warning discrimi- memory 630 A, the data of frame (n+1) are stored in memory 
nation circuit 631, scale generating circuit 632, and image 20 630B, the data of frame n are stored in memory 630C, the 
combining circuit 633. Amplifier 621 has a variable gain, data of frame (n-1) are stored in memory 630D, the data of 
which is set at a suitable value by system controller 61. The frame (n-2) are stored in memory 630E, and n is stored in 
four frame delay memories 623 through 626 are provided to memory 630F. The aforesaid measurement data Ds trans- 
output light reception data Dg of five frames simultaneously mitted to host 3 as the main measurement result are com- 
to memories 630A and 630F. 25 bined data of light reception data Dg stored in memories 
Memories 630A through 630F are provided to store light 630A through 630E, and frame number FN stored in 
reception data Dg of five effective cycles, and respectively memory 630F. 

have capacities sufficient to store a number of light reception Warning discrimination circuit 631, scale generating cir- 

data Dg identical to the number of measurement sampling cuit 632, and image combining circuit 633 are circuits for 

points (ie., number of effective pixels of image sensor 53). 30 the monitor display (preview) of the measurement result. 

Memory 630F is provided to store the specific frame number The light reception data Dg from memory 630C, the frame 

FN of each pixel g, and has a capacity sufficient to store a number FN from memory 630F, and scale value sc from 

number of individual frame numbers FN identical to the system controller 61 are input to warning discrimination 

number of sample points. Memories 630B through 630F circuit 631. Warning discrimination circuit 631 outputs 

receive common output signals S627 from comparator 627 35 distance image data D21 representing the three-dimensional 

as write signals. In contrast, one signal selected by mum- shape of the measurement result in achromatic variable 

plexor 629 from among the two signals comprising output density (grayscale), and three types of warning signals Sll, 

signal S627 and clock signal CK is input as a write signal to S12, and S13 in accordance with the combination of the 

memory 630 A. The clock signal CK is selected as a write values of the three types of input. Distance image data D21 

signal in the preliminary measurement That is, in the 40 are luminance data of three colors of red (R), green (G), and 

preliminary measurement, writing to memory 630A is blue (B) stipulating the display color of each pixel of the 

accomplished simultaneously with the conversion operation image. Scale generating circuit 632 generates a band-like 

of AD converter 622. gradation image (scale bar) 90 showing the relationship 

In the measurement following the preliminary measure- between the variable density of the distance image and the 

ment (referred to as "main measurement*' in the present 45 object distance. Image combining circuit 633 combines the 

discussion), the reading of 1 -frame in image sensor 53 does display data of scale bar 90 with the distance image data 

not target the entirety of imaging surface S2, but rather only D21. 

the effective light reception area (band-like image) Ae of 3-3. Preview Display of Measurement Result of Three- 
part of the imaging surface S2 as shown in FIG. 16 to dimensional Position 

increase speed. The effective light reception area Ae shifts 50 FIG. 17 is a block diagram of warning discrimination 
only 1-pixel each frame in conjunction with the deflection of circuit 631. FIG. 18 shows the display format showing the 
sHt light U. In the present embodiment, the number of pixels relationship between the input and output of warning dis- 
of effective reception area Ae m trie shift direction is fixed * crimination circuit 631. --- -~ - •■ - i ~ «~ -~ 
at 32. The width of these 32 pixels corresponds to the Warning discrimination circuit 631 comprises two corn- 
distance range (measurable range) of a measurement sub- 55 parators 631 and 6312, and a look-up table (LUT) 6313. The 
ject The method of reading only part of the image sensed by light reception data Dg of the effective number of pixels are 
the CCD area sensor is disclosed in VS. patent application serially input from memory 630C to comparators 6311 and 
Ser. No. 08/358,306. 6312 for each pixel. Comparator 6311 outputs a low lumi- 
AD converter 622 serially outputs light reception data Dg nance detection signal SL when the value of light reception 
of 32 lines each frame in the sequence of the arrangement of 60 data Dg expressing the maximum amount of received light 
pixels g. The frame delay memories 623 through 626 are of a target pixel is less than a threshold value thB which is 
FIFO memories (first- in first-out memories) having capaci- the lower limit of permissible reception. On the other hand, 
ties sufficient for storing 31 (Le., 32-1) lines. The tight comparator 5312 outputs an overflow warning signal S13 
reception data Dg of target pixel g output from AD converter when the value of light reception data Dg exceeds an 

622 are compared, via comparator 626, to the maximum 65 threshold value thA which is the upper limit of permissible 
value of past fight reception data Dg of the target pixel g reception. Look-up table LUT 6313 outputs distance image 
stored in memory 630 in the time 2-frames are delayed. The data D21, proximal warning signal Sll, and distal warning 
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signal S12 in accordance with the combination of values of the optical reception system, and the movement of variator 

the frame number FN, scale value sc, low luminance detec- lens 422 is controlled based on said calculation. Lens control 

tion signal SL, and overflow warning signal S13. on the projection side produces a slit light U having a width 

The scale value sc expresses the position of the measure- of 5 pixels incident on the image sensor 53 regardless of the 
ment reference surface within a measurable range stipulated 5 field an &k or image sensing distance, 
by the width of the effective light reception area Ae, and is System controller 61 reads the encoder output (repeated 
a value from 0 to 31. The default value of scale value sc is amount Ed) of focusing drive system 59, and the encoder 
16. In the main measurement, the measurable range is set to output (zoom value fp) of zooming drive system 60 via lens 
virtually center the position of the measurement reference controller 58. An imaging parameter data corresponding to 
surface. Frame number FN expresses the object position 10 repeated amount Ed and zoom value fp are output to host 3 
(i.e ., strictly the position of a sampling point corresponding wu ^ ) reference to distortion table TL, principal point position 
to a target pixel) within a measurable range. Basically, the table T2, and image distance table 13 within system con- 
distance image data D21 are grayscale converted data troHer 61. The imaging parameter data include distortion 
directly expressing the frame number FN. That is, the parameters (Le., lens distortion correction coefficients dl 
luminance Yr, Yg, and Tb of R, G, and B in the grayscale are 15 ^ <&X proximal principal point position FH, and image 
8x(FN-sc+16). In the present embodiment, specific pixels distance b. The proximal principal point position FH repre- 
are intensified by the color display to facilitate visual sents the distance between proximal side principal point H 
recognition of measurement results. and proximal side end point F of zoom unit 51 (refer to FIG. 

As shown in FIG. 18, if the low luminance detection 22c)- Since the proximal side end point F is fixed, the 
signal SL is active (ON), the display color of this pixel is 20 proximal side principal point F can be specified by the 
black. That is, on the display screen, the pixels wherein the proximal principal point position FH. 
reflectivity of the object is extremely small and the pixels System controller 61 executed the preliminary measure- 
outside the measurable range are displayed in black. If the ment to accomplish environmental measurements affecting 
overflow warning signal S13 is ON, the pixel is displayed in slit light U projected in a specific direction, determines the 
red to alert a user that the time center Npeak cannot be 25 object distance d by a triangulation method based on imag- 
a ecu rate ly calculated The pixels wherein the frame number m g information obtained in said preliminary measurement, 
FN and scale value sc are equal are displayed in cyan to aid resets the repeat amount Ed and drives lenses, and sets the 
recognition of the positional relationship between the mea- operation of the main measurement. Settings include the 
surement reference surface and the object. The image cor- output (laser light intensity) of semiconductor laser 41, slit 
responding to the edge on the proximal side of the measur- 30 light U deflection conditions (Le., projection start angle, 
able range is displayed in green, and the image projection end angle, angular speed of deflection) and the 
corresponding to the edge on the distal side is displayed in ^ 

blue. A user can readily recognize whether or not a desired 1° the preliminary measurement, the projection angle is 

portion of an object is accurately measured by means of the 5000 mat the reflected light is incident at the center of 

aforesaid display. 35 imaging surface S2, and the approximate object distance dO 

3^. Three-dimensional Position Measurement Sequence assumes a flat surfaced object The semiconductor laser 41 

The combined measurement sequences of the operations executes pulse emission and the amount of received light is 

performed by the host 3 and three-dimensional camera 2 are measured, then the projection intensity is adjusted to attain 

described hereinafter. The number of effective pixels a suitable amount of light reception. At this time, if a 

(sampling points) on imaging surface S2 of the image sensor 40 required amount of light reception is not obtained even with 

S3 used for measurement is 244x256, Le., 1-frame is 244x me projection intensity set at the upper limit permitted for 

256 pixels, and data of 2444 frames are obtained by sam- the rating of the laser and human safety, the measurement is 

pling 244 times. Thus, the actual number of frames N is 244, stopped, and both an audible alarm is sounded and warning 

and the number of pixels in the slit length direction on message is displayed. In the calculation of object distance d, 

imaging surface S2 is 256. 45 consideration is given to offset doff in the z direction of 

A user determines the camera position and direction to set projection origin A and proximal principal point H of the 

the angle of field while viewing a color image displayed on optical reception system which is the measurement reference 

liquid crystal display 21. A zooming operation may be point. When calculating the deflection conditions, a mea- 

performed at this time if necessary. The three-dimensional surable range d* equal to the d=center portion is maintained 

camera 2 displays a color monitor image with exposure 50 at the edge area in the scanning direction so as to overscan 

controlled by an electronic shutter function without aperture by a predetermined amount (e.g., 8 pixels). The projection 

adjustment relative to color sensor 54. This arrangement start angle thl, projection end angle th2, and angular speed 

increases as much as possible the amount of incident light - of deflection 0 are expressed by. Equations (1), (2), and (3)- 

reaching image sensor S3 by setting the aperture in an open below, 

state. 55 

FIG. 19 shows the flow of data in three-dimensional U xpv (^ + l80 (1) 

camera 2. FIG. 20 shows the flow of data in host 3. FIG. 21 rAi = tair , l J* ' — x-^- 

fllustrates the positional relationship between the object Q * 

and each point of the optical reception system 50. r - JW+A + i] (2) 

Focusing is accomplished by moving focusing lens 512 in 60 rA? = tnq" t L 180 

conjunction with the movement of variator lens 514 of zoom * d+doff J x 

unit 51 in accordance with a field angle selection operation ihi-dil p) 

(zooming) initiated by a user activating zoom buttons 25a w - — — — 
and 25b. The focusing process generally measures the 

approximate object distance dO. The amount of movement of 65 

variator lens 422 on the projection side is calculated via fi: Imaging magnification (-d/effective focal length Freal) 

computation in conjunction with the driving of the lens of pv: pixel pitch 
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np: Number of effective pixels in Y direction of imaging When the reference position for calculating the object 

surface S2 distance is set at the proximal distance (on three- 

L: Baseline length dimensional camera 2 side) of the object and measurable 

Thus, toe main measurement is accomplished under the range d* is set before and after said position, the proximal 

calculated conditions. Object Q is scanned, and measure- 5 side (three-dimensional camera 2 side) of the measurable 

ment data Ds of 5 frames/pixel are generated by output range often becomes unreasonable. Therefore, the shift 

process circuit 62. Then, the previously described distance amount may be set to pitchoff, and the measurable range d' 

image monitor display is accomplished Three-dimensional may be shifted on the distal side so as to achieve a 25% 

camera 2 is provided with a preview function (described in proximal side and 75% distal side ratio, 

detail later) to facilitate remeasurement. A user specifies 10 # . «. . . . . A . ^ . . 

remeasurement as necessary while viewing the Stor .™* D **J*«*™ li^receivmg area Ae is 32pixels 

display. In remeasurement mode, when a user changes the ^ te P™* ni embodiment (x.e., when the CCD area 

measurement conditions, a theoretical distance image is scnsor h jf a o{ ? 2 P* els >> me afoKssad 

generated in accordance with the new measurement condi- measurable range ratio can be set by setting the shift amount 

tions based on measurement data Ds of the previous 15 pitchoff at [8]. The measurable range d w after shifting is the 

measurement, and this theoretical image is displayed as a ran 8 e m HG - 22c - 

preview image. Since the preview image is displayed in real As shown in FIG. 20, host 3 executes the slit center 

time in conjunction with the condition changing operation, calculation, distortion correction calculation, camera line- 

a user can effectively accelerate optimization of the mea- of-sight equation calculation, slit surface equation 

surement conditions. When enters the end of the condition 20 calculation, and three-dimensional position calculation, so 

changes, remeasurement is executed, and new measurement 35 to calculate the three-dimensional position (X, Y, Z 

data Ds are generated. coordinates) of 244x256 sampling points. The sampling 

When a user presses the record button 28, the measure- points are the intersections of the camera line -of-sight (line 

ment data Ds are transmitted to host 3. At the same time, the connecting the sampling point and proximal principal point 

device information D10 which includes the deflection con- 25 H) and the slit surface (sampling point illuminated on the 

ditions (deflection control data D43), specifications of image optical axis plane of the slit light U). 

sensor 53 and the like are transmitted to host 3. Table 1 The time center Npeak (refer to FIGS. 4a and 46) of slit 

shows the main data transmitted to host 3 from three- light U is obtained by Equations (4) and (4*) using light 

dimensional camera 2. reception data Dg(i) of each sampling time. 



TABLE 1 



Device Information 



TWo-di menaooal 



Bank F (Frame No.) 
Bank A (n + 2) 
Bank B (n + 1) 
BankC(n) 
Bank D (n - 1) 
Bank E (n - 2) 
cb 



244 x 256 x 8 fait 0-255 

244 x 256 x 8 bit 0-255 

244 x 256 x 8 bits 0-255 

244 x 256 x 8 bits 0-255 

244 x 256 x 8 bits 0-255 

244 x 256 x 8 bits 0-255 

0.000-200.000 

Proximal principal point position FH 0.0O-3OCL0O 
Projection start angle thl 
Angular speed of deflection 

Measmemcnt pixel No. (No. samples in 1- 
X, Y directions) 

Sensor pixel pitch pn, pv -0DQ516- 

Projcction posture (around X, Y, 7. axes) 0.00 -± 90X0 

Projection posture (X, Y, Z axes directions) 0.00 -* 300.00 
Lens distortion correction coefficients dl, d2 

Sensor center pixel u0, vO 0.00-25600 

R plane 512 x 512 x 8-bits 0-255 

G plane 512 x 512 x 8-bits 0-255 

B plane 512 x 512 x 8-bits 0-255 



When setting the projection start angle thl and projection 
end angle th2, the measurable distance range can be shifted 
on the optical axis if Eq. (Y) and (2*) below are substituted 
for Eq. (1) and (2). 



55 



= X2n [ d+doff J*T~ 

\fixpv(%+*+pdctoff) + L\ 180 

= tan" 1 I x 

I d + doff J jt 



60 



65 



pitchoff: amount of shift of measurable distance range 



Npeak = n + An (4) 
-2xDg(fl-2)-Dg(n-l) + Dg{n + l)+2xDgin+2) 

(i = n-2,n-l,fl,n + l,n + 2) 

-2 X [Dg(n - 2) - minDg(i)] - [Dg{n — I) — minDgH)] + (4') 
. [Dgifl + 1) - mjnDftfA + 2 x [Dgjn 4- 2) - mmDgji)] 
LDgii) 

The influence of environmental light can be slightly 
reduced by subtracting the minimum data minDg(i) among 
the five light reception data to determine the weighted mean. 
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The camera line-of-sight equations are Equations (5) and 
(6) below. 



b X 

(u-rf) = (*p)= — x— - 
pu Z 



FH 



<5) 



(6) 



b: image distance 

F: proximal principal point position 
pu: pixel pitch in a horizontal direction on the imaging 
surface 

pv: pixel pitch perpendicular to the imaging surface 
u: pixel position in a horizontal direction on the imaging 
surface 

U(fc center pixel position in the horizontal direction on the 

imaging surface 
v: pixel position in a perpendicular direction on the 

imaging surface 
vO: center pixel position in a perpendicular direction on 

the imaging surface 
The sHt plane equation is expressed by Equation 7 below. 



10 
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3-5. Preliminary Measurement of Three-dimensional Posi- 
tion 

The auto setting function of the three-dimensional camera 
2 is described below. 

Three-dimensional camera 2 sets the main measurement 
conditions (i.e., projection angle range and laser intensity) 
based on the results of the preliminary measurement Unlike 
the main measurement, in the preliminary measurement the 
sKt light U is projected only unidirectionalry without deflect- 
ing sHt light U. The projection direction is selected in 
accordance with the zooming condition, and the output of a 
passive type distance sensor provided separately. Projection 
is accomplished intermittently a total of three times within 
a short period, and the laser intensity (projection light 
intensity) is decreased from a higher value to a lower value 
for each projection. That is, measurements are conducted 
using three types of slit light U of intensities A, B, and C 
wherein A>B>C. The imaging information obtained by 
image sensor 53 during projections of slit light U at each 
20 intensity A, B, and C are temporarily stored in memory 
630 A, and subsequently used for predetermined calcula- 
tions. The reading of imaging information (light reception 
data Dg) from memory 630A is accomplished for only a part 
of the imaging surface S2 rather than the entirety of said 
imaging surface S2. In the present embodiment, the time 



cxn{theS) -usithe3) 0 1 I" cos(rhe2) 0 ar(the2) 
withtJ) cosithe3) 0 1 I 0 1 0 
0 0 iJl-an(iAe2) 0 cos(ite2) 

1 0 0 

0 an(tkel +the4Cnop) -withe I +tke4Cnop) 
0 sx#fe/4-{ft04Owp) co5(/Ar/ + ihrfOwp) 



(7) 



[XY -LZ-s]=0 



Geometric distortion is dependent on the field angle. 
Distortion in an object centered on the center pixel. 
Accordingly, the amount of distortion is expressed by as a 
function of the distance from the center pixel. The distance 40 
approaches a cubic function. The two-dimensional correc- 
tion coefficient is designated dl, and the three-dimensional 
correction coefficient is designated d2. The corrected pixel 
positions u* and v* are expressed by Equations (8) and (9) 
below. 45 

a a 

t -2 v-vO _ ^ v-vO (9) 

v ^v+dlxtrx—g- +d2x&*x — j^— 50 

i2 = (r/r l 
tl = (u-uO? +{v-vOf 

The three-dimensional position can be determined with 55 
consideration given to the effects of distortion by substitut- 
ing u* for u and v* for v in Equations (5) and (6). Calibration 
has been fully described by Onodera and Kaneya in "Geo- 
metric correction of images without camera positioning," 
Research Committee Publication PRU91-113, The Institute 60 
of Electronics, Information and Communication Engineers, 
and Ueshiba, Yoshimi, Oshima et al in "High precision 
calibration method for rangefinders based on three- 
dimensional models in optical systems," Journal of The 
Institute of Electronics, Information and Communication 65 
Engineers, D-D, VblJ74-D-II, No. 9, pp. 1227-1235, 
September, 1991. 



required for the preliminary measurement can be shortened 
by limiting the projection direction and reading range of 
imaging information, and reliability can be increased by 
projecting three types of slit light U of different intensities. 

FIG. 23 shows the sampling range during the preliminary 
measurement. 

In the preliminary measurement, the five lines vl through 
vS are targeted for sampling from among the 244x256 
individual pixels comprising the imaging surface S2 of 
image sensor S3. Each line vl through v5 is a row of pixels 
from one end to the other end in the Y direction (deflection 
direction of slit light U% and arrayed at equal spacing near 
the center in the X direction. The coordinate (pixel number) 
in the X direction of each line vl through vS is sequentially 
110, 120, 128, 140, and 150, and are selected values within 
the measurement area A57 of AF sensor 57. Generally, the 
three-dimensional camera is positioned directly in front of a 
measurement object during the measurement operation, such 
that the near center of imaging surface S2 is suitable as a 
sampling point when obtaining effective information using 
the fewest number of sampling point possible. 

FIGS. 24a and 246 illustrate the relationship between slit 
images GS and sampling points. 

When the object Q is spherical, for example, a curved slit 
image GS is imaged. During the initial projection of the 
preliminary measurement, the data of all pixels of lines VI 
through v5 are read from memory 630 A, and the coordinate 
(slit image position) in the Y direction corresponding to slit 
image GS is detected. The black circles in FIG. 24a repre- 
sent the slit image position. In contrast, during the second 
and third projections, only data of three pixels g comprising 
the slit image pixel and pixels on bilateral sides thereof are 
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read from memory 630A relative to lines vl through v5 to 
save time because the slit image position has been previ- 
ously detected. The pixels g which are shaded in FIG. 246 
correspond to the silt image position. 

FIG. 25 shows the data content of preliminary measure- s 
ment table T5. 

Preliminary measurement table T5 is provided in RAM 
(not shown in the drawing) built in system controller 61. The 
light reception data Dg from the projection of slit light U at 
each intensity A through C and predetermined data (eg., slit 10 
image position and the Hke) obtained based on said data Dg 
are stored for each line vl through v5 as preliminary 
measurement data. 

FIGS. 26a and 26b are graphs showing typical examples 
of the relationship between projection light intensity and the 15 
amount of light reception. 

In the example of FIG. 26a, the light reception level at 
intensities A through C are lower than a saturation level (i.e., 
the upper limit of the dynamic range of light reception). 

If the light reception level is within the nonsaturated range 20 
and there is no influence from environmental light or signal 
noise, a proportional relationship exists between the inten- 
sities A through C and reception data Dg. Accordingly, the 
light reception level at the optional projection intensities can 
be estimated from the reception data Dg of the various 25 
intensities A through C. In other words, the projection 
intensity obtained from the optimum light reception level 
can be determined by calculation. When the magnitude 
relationship of intensities A through C do not match the 
magnitude relationship of light reception data Dg, there is a 30 
problem with reliability of light reception data Dg. The 
results of suitability discrimination of lines vl through v5 
are stored in the previously mentioned prehminary measure- 
ment table T5. 

System controller 61 deterrnines the object distance via a 35 
triangulation method based on the slit image position of 
lines selected by the criteria described later from among the 
five lines vl through v5, and sets the lens position conditions 
for the main measurement. Thus,, the measurement range is 
determined. Thereafter, system controller 61 optimizes the 40 
projection light intensity of the main measurement based on 
preliminary measurement data of lines within the measur- 
able range among the five lines vl through v5. 

FIGS. 22a, 22b, and 22c illustrate the sequence of opti- 
mization of projection light intensity. FIG. 27 is a graph 45 
showing the optimized intensity corresponding to FIG. 22. 

In FIG. 22a, a cube-like object Q is disposed on the front 
side of background surface SB. FIG. 22b shows slit image 
GS when slit right U is projected toward object Q. The slit 
image positions of lines vl through v5 on imaging surface 50 
S2 are designated Ft through P5. FIG. 22c is a plan view 
showing the positional relationship between object Q and 
each slit image position PI through PS/As shown in FIGS. - 
22b and 22c, slit image positions P2 and F3 correspond to 
the object Q, whereas the other three slit image positions PI, 55 
P4, and PS correspond to the background surface SB. 

Slit image position P3 is designated the reference position 
(focus point position) for calculation of the object distance. 
The black dot circumscribed by a circle indicates the refer- 
ence position. The measurable range d* is determined by 60 
selection of the reference position. As shown in FIG. 22c, 
slit image positions P2 and P3 are inside of measurable 
range d', whereas the other three slit image positions PI, P4, 
and PS are outside of measurable range <f, and are not be 
image during the main measurement. The X marks in the 65 
drawings indicate positions outside the object in the main 
measurement The projection light intensity of the main 
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measurement is set based on preliminary measurement data 
of lines v2 and v3 which include slit image positions P2 and 
P3 corresponding to the imaging subject during the main 
measurement. 

As shown in FIG. 27, the optimum level projection light 
intensity is determined for each slit image position P2 and 
P3 from actual measurement values of the amount of light 
reception of lines v2 and v3 at each intensity A through C. 
The smallest value among the two obtained projection light 
intensities is used as the set value of the main measurement. 
If there are three or more slit image positions within the 
measurable range d', the minimum value among the deter- 
mined optimum projection light intensities is used. The use 
of the minimum value avoids reception light saturation. 
3-6. Preview Function in Measurement of a Three- 
dimensional Position 

FIG. 28 shows a measurement example illustrating the 
preview function. FIGS. 29a and 29b show examples of 
modified measurement conditions. FIGS. 30a and 30b show 
the contents of the monitor display corresponding to FIGS. 
29a and 29b, respectively. 

A Figurine of a bird is used as object Q used as a 
measurement subject, and measurement was conducted from 
the apparent frontal surface corresponding to the face of the 
bird. As shown in FIG. 28, a high luminance area q exists on 
the front torso of the bird. FIG. 29a shows the set condition 
of measurable range d' during initial measurement, and FIG. 
29b shows the set condition of measurable range d 1 during 
remeasurement. FIG. 30a corresponds to FIG. 29a, and FIG. 
30b corresponds to FIG. 296. 

At the stage at which the initial measurement ends, the 
screen of liquid crystal display 21 displays the distance 
image Gl, scale bar 90, numerical value zl expressing the 
object distance (units: mm) of measurement reference posi- 
tion el, numerical values z2 and z3 expressing the object 
distance at both edges e2 and e3 of the measurable range d 1 , 
arrow z4 indicating the display luminance corresponding to 
measurement reference position el on scale bar 90, and 
numerical value zS expressing the set value of projection 
light intensity. In practice, the shaded regions in FIGS. 30a 
and 30b are displayed in black, and the whiteout areas are 
displayed in achromatic colors of densities (brightness) 
corresponding to measurement values illustrated in FIG. 18. 
Normally, the entirety of the whiteout areas have the same 
densities. 

In FIG. 29a, the measurement reference position el is set 
near the center of the head of the bird, and the tip of the beak 
protrudes from the proximal side of measurable range d\ In 
distance image Gl of FIG. 30a, the green area (continuous 
or intermittent linear pixel groups) E2 corresponding to the 
proximal side edge e2 of measurable range 6? is discrimi- 
nated. Furthermore, distance image Gl includes blue area 
E3 corresponding to the distal edge e3, and red area Eq 
corresponding to the high luminance area q. 

A user shifts the measurable range d* further forward on 
the proximal side. This operation may be accomplished by 
pressing the down cursor button 22 (refer to FIG. 2b) a 
required number of times. Each time cursor button 22 is 
pressed, the arrow mark 24 moves downward on the display 
screen, and numerical value zl is updated. The monitor 
image can be rewritten in real time in conjunction with this 
condition modification operation. In the state of FIG. 29b, 
the entire beak is put within the measurable range d\ The 
absence of the green area representing a proximity warning 
in the preview image Gl of FIG. 30b is thus recognized. 
Since preview image Gl is generated based on the previous 
measurement data Dg, the missing beak in distance image 
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Gl is not actually measured, and that area in preview image relatively high precision. Therefore, proximal principal 

Gl' is displayed in black. Furthermore, the areas outside the point position FH, effective focal length Freal, and object 

new measurable range are displayed in black in accordance distance dO are calculated from feed-out amount Ed and the 

with the modification of the measurable range d\ zoom level (#102, #103), and thereafter the projection angle 

4. Control Flow Chart of the Measurement Operation of the 5 is calculated so that the slit light U is incident at the 

Three-dimensional Camera intersection of the object surface and the light reception axis 

4-1. Main Control Flow (#104). Then, the galvano mirror 43 is set at a rotation angle 

FIG. 31 is a flow chart of the control sequence of the position corresponding to the calculated projection angle 

measurement operation of the three-dimensional camera 2. (#150). 

An active type "preliminary measurement" is executed in 10 On the other hand, since passive type measurement accu- 

conjunction with the focus locking operation of record racy is low and the field of the reception system is broad in 

button 28 (#11 and #12). When the measured object distance the wide telephoto state, slit light U reflected by an object 

d is outside the imaging distance range determined by can be received if the projection direction is switched 

specifications, an error process is executed (#13, #23). In the between distal and proximal. After fixed value are set as the 

error process, a predetermined message is displayed on is proximal principal point position FH and effective focal 

liquid crystal display 21, and a buzzer 75 is sounded. If the length Freal in accordance with the zoom level, the prede- 

object distance d is within the measurable range, termined angle corresponding to the feed-out Ed is set as the 

subsequently, an image sensing process is executed to obtain projection angle (#106 to #109). Then, the galvano mirror 43 

measurement data Ds in conjunction with a release operation is set at the rotation angle position corresponding to the 

of release button 27 process (#14, #15). On the other hand, 20 projection angle identical to the telephoto state (#105). 
a preliminary measurement is accomplished to aetermine the FIG. 34 is a flow chart of the "environmental light image 

suitability of object distance d even when the release opera- sensing" of step #20 of FIG. 32. 

tion is executed without a focus locking operation (#20 to The image sensing mode is set to the mode for prelimi- 

#22). If the object distance and amount of light reception are nary measurement (#201). That is, regarding image sensor 

suitable, the routine continues to the "main measurement," 25 53, the mode is set to read photoelectric conversion signals 

whereas the error process is executed if the object distance of all pixels of imaging surface S2, and input is selected for 

and light reception are unsuitable (#15, #23). multiplexor 629 of output process circuit 62 such that the 

When an undo operation is executed by undo button 29 write signal of memory 630A becomes the clock signal OC 

after the image sensing is completed, the "re measurement Thus, imaging information of 1 screen (i.e., entire area of 

process" is executed (#16, #19). When the record operation 30 imaging surface S2) of image sensor 53 for each image 

is executed by record button 28, a record process is executed sensing operation is stored in memory 630 A. 
to output measurement data Ds to host 3 or recording The gain of amplifier 621 of output process circuit 62 is 

medium 4 (#17, #18). The display of FIG. 30a is displayed set at an initial value [1] (#202), and the CCD drive process 

in the image sensing routine (#15), an operator verifies areas is executed to control image sensor 53 (#203). Specifically, 

which cannot be measured, and can selectively use these 35 the start and end integral (load accumulation) is specified for 

measurement results or drive 55. Then, A data transfer process is executed to store 

4-2. Preliminary Measurement Process the imaging information (light reception data Dg) in 

The specific sequences of the "preliminary measurement" memory 630 A (#204), and the fight reception data Dg of the 

of steps #12 and #21 of the flow chart in FIG. 30 are fully five lines vl through v5 are read from memory 630 A (#205). 
described hereinafter with reference to the flow chart. 40 FIG. 35 is a flow chart of the "slit image imaging" process 

FIG. 32 is a flow chart of the "preHminary measurement" of step #30 of FIG. 32. 
executed by system controller 61. In this routine, image sensing is accomplished a total of 

System controller 61 sequentially executes various pro- three times while semiconductor laser 41 emits pulse bursts, 

cesses including the "preliminary measurement condition As described by FIG. 24a, the imaging information of the 

setting" process which determines the projection direction of 45 first cycle is particularly important in the detection of the slit 

slit light U (#10), "environmental light image sensing" image position. The greater the laser light intensity 

process to obtain environmental information when slit light (projection light intensity), the lower is the influence of 

U is projected at three intensities A, B, and C (#30% noise. Accordingly, the laser intensity of imaging in the first 

"Imaging information suitability discrimination" process cycle is set at intensity A (#310). Then, light projection/light 

which increases preliminary measurement reliability (#40), 50 reception controls (#320), and "sampling at intensity A" 

"distance calculation" process to determine the object dis- (#330) are sequentially executed. The light projection ./light 

tance (#50), and "main measurement condition setting" reception controls comprise the following processes (1) 

process to set the main measurement operations conditions through (4) below. - i«i-*--s=«==w 

in accordance with the result of preHminary measurement (1) LD driver 44 in instructed to turn ON the laser 41. 

(#60). 55 (2) Instruct LD driver 44 to turn OFF the laser 41 after a 

FIG. 33 is a flow chart of the "preliminary measurement predetermined time has elapsed, 

conditions setting" process of step #10 of the flow chart of (3) The end of integration is specified. 

FIG. 32. (4) Light reception data Dg of 1 screen is stored in memory 

First, the values are set for the three projection light 630A. 
intensities A, B, and C in accordance with the zoom value at 60 The routine then moves to the second imaging cycle, and 

that time (#100). The number of zoom levels is, for example, laser light intensity is set at intensity B (#340). After 

19, and specified by the zoom value fp. The effective projection/reception controls identical to the first cycle are 

measurement results can be readily obtained by varying the executed (#350), the "sampling at intensity B" process is 

intensities A, B, and C. executed (#360). 

Then, the zoom state is checked (#100). When the zoom 65 During the imaging of the third cycle, laser light intensity 

level is 4 or higher, the measurement results can be used is set at intensity C (#370), and after projection/reception 

because the passive type measurement of AF sensor 57 has controls identical to the first cycle are executed (#380), the 
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"sampling at intensity C process is executed (#390). The reception data Dg of the target pixel is read from memory 

content of the "sampling at intensity C process is identical 630A (#3605), and the laser component j, from which the 

to the content of the "sampling at intensity B" process environmental light component has been subtracted, is cal- 

(#360). dilated as previously described (#3606). When the laser 

FIG. 36 is a flow chart of the "sampling at intensity A" 5 component] is greater than the laser measurement value j at 

process of step #330 of FIG. 35. that moment, the laser component j is written to preliminary 

The first line vl is selected as a target line from among measurement table T5 as the laser measurement data j at 

five lines vl through v5 of the sampling object (#3301). intensity B (#3607, #3608). Then, the next pixel is targeted, 

The laser measurement value J of the target line stored in and the same process is executed (#3609, #3611). That is, the 

preliminary measurement table T5 is set as a minimum value 10 laser component j of each pixel is compared, and the 

at initialization (#3302). The top pixel of the target line is maximum value of laser component j in the target line is 

selected as the target pixel, and the light reception data Dg stored. If the processing is completed for a total of three 

of the target pixel is read from memory 630A (#3304). The pixels including the slit image position and pixels on bilat- 

light reception data (environmental light component) of the era! sides thereof, the next line is targeted, and the maximum 

target pixel read in the aforesaid "environmental light imag- is value of laser component j of three pixels is stored in the 

ing" process is culled from the read reception data Dg, and same manner as for the previous line (#3610, #3612). When 

the laser component j is calculated (#3305). When the laser processing is completed for the five lines vl through v5, the 

component j is greater than the lower limit reception level routine returns to the flow of FIG. 35. 
(lower limit of slit light U), i.e., when greater than the laser FIG. 38 is a flow chart of the "imaging information 

measurement value J (#3306, #3307), the Y coordinate of the 20 suitability discrimination" process of step #40 of FIG. 32. 
target pixel is written to preliminary measurement table T5 The first line vl is selected as the target line from among 

as the slit image position (#3308), and laser component j is the five lines vl through v5 of the sampling target (#401), 

written to table T5 as the laser measurement value J of and a check is made to verify whether or not the slit image 

intensity A (#3309). Thereafter, the next pixel is targeted position of the target line is stored in preliminary measure- 

(#3314, #3315). If the reply to the query of steps #3306 or 25 ment table T5 (#402). When the slit image position is not 

#3307 is NO, the next pixel is targeted without updating the stored in table T5, the preliminary measurement data of the 

preliminary measurement table T5. The brightest pixel of the target line is discriminated as ineffective, and a flag indi- 

target line can be detected by sequentially targeting all pixels eating this status is set in preliminary measurement table T5 

of a target line, and comparing the laser component j and (#410). Then, the next line is targeted (#411, #412). 
laser measurement value J. The brightest pixel corresponds 30 When the slit image position is stored in table T5, the 

to the slit image position. Since me laser component j of suitability of the preliminary measurement data is discrimi- 

each pixel is compared, there is few errors in position nated by the following criteria. 

detection in comparison with when the right reception data First, a check is made to determined whether or not the 

Dg including an environmental light component are com- intensity A light reception data Dg (environmental fight 

pared. 35 component+laser component) at the slit image position is at 

If the comparison process if completed for all pixels of the saturation level (#403). If the reception data Dg at intensity 

target line, the next line is targeted and the same process is A are at saturation level, a check is made to determine 

required (#3311, #3315). If the comparison process is com- whether or not the reception data Dg at intensity B are at 

pleted for five lines vl through v5, a' check is made to saturation level (#413). If the reception data Dg of intensity 

determine whether or not a slit light position has been 40 B are at saturation level, a check is made to determine 

detected in at least one fine, Le., whether or not a pixel whether or not the reception data Dg of intensity C are at 

brighter than a predetermined value is present (#3312). If the saturation level (#414). If all reception data Dg at intensities 

maximum value of the laser component j in each line vl A, B, and C are at saturation level, the preliminary mea- 

through v5 attains a predetermined reference value (Le., a surement data of the target line is discriminated as unsuitable 

slit image position is found), the routine returns, whereas if 45 (#410). 

said predetermined value is not attained, the gain of ampli- If the reception data Dg of intensity A is not at saturation 

fier 621 of output process circuit 62 is updated to a value one level in step #403, a check is made to determine whether or 

step higher (#3316, #3317). After the gain is updated, the not the relationship between intensity and light reception is 

routine returns to the "environmental fight imaging" process correct That is, a check is made to verify whether or not the 

to correct imaging- If the gain attains an upper limit in step 50 laser measurement value J of the laser component at inten- 

#3316, an error process is executed to display a suitable sity A is greater than the laser measurement value J at 

message (#3318). Even when a slit image position is not intensity B (#404), and a check is made to determine 

found, the gain of amplifier 621 is -increased one -level - whether or not the laser measurement value J of intensity B * 

(#3316, #3317), the routine returns to the "environmental is greater than the laser measurement value J of intensity C 

light imaging" process to correct imaging. 55 (#405). A check of step #405 is executed when the reply to 

FIG. 37 is a flow chart of the "sampling at intensity B" the query of step #403 is NO. When the relationship of the 

process of step #360 of FIG. 35. magnitude of the intensity and the magnitude of the laser 

The first line vl is selected as the target line from among measurement value J is reversed, the preliminary measure- 

tbe five lines vl through v5 of the sampling target (#3601). ment data of the target line are discriminated as ineffective 

A check is made to verify whether or not the slit image 60 because the anomaly is obvious (#410). If the magnitude of 

position in the target line is stored in preliminary measure- the intensity and the magnitude of the laser measurement 

ment table T5 (#3602). When the slit image position is not value J is suitable, the slope of the graphs described in FIGS, 

stored in table T5, the next line is targeted. 26a and 26b can be determined from the environmental light 

When the slit image position is stored in table T5, the component which is the measured light value when the 

pixel immediately prior to the sht image position is targeted 65 intensity and laser measurement value can be calculated for 

after the laser measurement value J of the target line is the laser component at intensity C (#406). At this time, the 

initialized at a minimum value (#3603, #3604). The right laser measurement value J at intensity B is only used when 
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the reception data at intensity A is at saturation level. The use data of the target line are effective, a check is made to 

of the higher laser measurement value J is beneficial in determine whether or not the position on the object corre- 

mimmizing errors of the slope of the graph. sponding to the slit image position of the target line is within 

Regarding the laser component at intensity C, if the the measurable range (image sensing range of the main 

difference between the actual measurement value and the 5 measurement) set at standard object distance d (#6304). 

estimated value is within the permissible range (#407% the When the slit image position pertains to the sensed image 

preliminary measurement data of the target line are dfccrimi- during the main measurement, the data previously stored 

nated as effective (#408), and the preliminary measurement during the "imaging information suitability" routine are used 

data of the highest nonsaturated intensity among the recep- to calculated the optimum value of laser intensity at the slit 

tion data Dg of intensities A, B, and C are stored as the 10 image position (line) (#6305). If the calculation result is 

measurement conditions for the main measurement (#409). greater than the permitted maximum value, the permissible 

Then the next line is targeted, and same process is repeated maximum value is used as the calculation result (#6306, 

for the top line. Thus, the optimum data are selected for #6307). When the calculation result is less than the set 

setting the parameters of the main measurement from among intensity value at that time, the set intensity value is changed 

the five lines vl through v5. When difference between the is to the calculation result (#6309). the processes of steps 

actual measured value and the estimated value exceeds the #6303 through #6309 are executed for each of the five lines 

permissible range, the preliminary measurement data of the (#6310, #6311). thus, among the optimized values corre- 

target line are deemed ineffective. sponding to each slit image position of the sensed object of 

FIG. 39 is a flow chart of the "distance calculation'' the main measurement, the smallest value becomes the 

process of step #50 of FIG. 32. 20 intensity for the main measurement. 

When the reliability of the preliminary measurement data 4-3. Main Measurement Process 

is low among all five lines vl through v5, Le., when the FIG. 42 is a flow chart of the "main measurement" 

preliminary measurement data of all five lines vl through v5 process of step #15 of FIG. 31. 

are deemed ineffective, and an error process is executed, and The projection angle range corresponding to the object 

the routine returns to the main routine (#501, #510). 25 distance d is set (#151), and scanning is executed (#152). 

If at least one line contains effective preliminary mea- The distance image obtained by scanning is displayed on the 

surement data, the first line vl is targeted (#502). If the target monitor (#153), and a check is made for the presence of a 

line contains effective preliminary measurement data, the warning a signal output from output process circuit 62 

object distance is calculated using a suitable triangularion (#154). When any signal among the proximity warning 

method based on the slit image position (#503, #504). Then, 30 signal Sll, digital warning signal S12, or overflow warning 

the next line is targeted (#505, #509). If the target line signal S13 is output, a message is displayed in accordance 

contains ineffective preliminary measurement data, the next with the output warning, and the buzzer 75 is sounded (#155, 

line is processed without calculating the object distance d. #156). Suitability discrimination is accomplished for the 

At the moment the processing ends relative to the five part (e.g., the center area) of the sensed image so as to reduce 

lines vl through v5, the maximum five calculated values of 35 the time required for the preliminary measurement. Thus, 

object distance d are stored. If the zoom level is the telephoto errors may be detected in the main sensed image outside said 

state, the calculated value of object distance d nearest the discrimination area, 

result of passive measurement is selected as the object 4-4. Remeasurement Process 

distance measurement value because the passive measure- FIG. 43 is a flow chart of the "remeasurement" process of 

ment of the aforesaid AF sensor 57 has a high degree of 40 step #19 of FIG. 31. 

accuracy (#506, #507). On the other hand, if the zoom The amount of projection light is set (#191), and there- 
condition is wide telephoto, the smallest value among the after the routine returns to the flow of FIG. 31 of the 
calculated values of object distance d is selected as the selection operation (#192). When the up or down cursor key 
measurement value (#508). This selection is made because, is pressed before the selection button 23 is pressed, the 
typically, the background assumes a distant position as the 45 arrow mark z4 on the monitor display is moved upward or 
object Q approaches the three-dimensional camera 2. downward (#193, #194, #198, #199). 

FIG. 40 is a flow chart of the "main measurement con- The object distance d, which corresponds to the arrow 

ditions setting" process of step #60 of FIG. 32. mark z4 position after the aforesaid movement, is calculated, 

If the object position indicated by object distance d and the display of numeric value zl is updated (#197). The 

selected as the measurement value is within the measurable so value corresponding to the position of arrow mark z4 and 

range, the following three setting processes are executed. scale value sc are updated (#198), and a preview image is 

First, the feed-out amount Ed suitable for the zoom level displayed (#199). The operator can modify settings while 

and the selected object distance d is calculated, and setas the - estimating imaging results after changing said setting via the 

focusing control value (#610). Then, the proximal principal preview image. When the selection button 28 is pressed, the 

point position FH and effective focal length Freal suitable 55 setting at that time are stored immediately and the routine 

for the zoom level and calculated feed-out Ed is calculated, returns. Thereafter, image sensing is accomplished at the 

and set as lens information (#620). The lens information is aforesaid set conditions via the release operation of step #14. 

used in the calculation of the projection angle range and FIG. 44 is a timing chart showing an example of syn- 

coordinate calculations by host 3. Finally, the "projection chronous control of gafvano mirror 43 and image sensor 53. 

intensity setting" process is executed (#630). 60 FIG. 45 is a timing chart showing an example of another 

FIG. 41 is a flow chart of the "projection intensity setting" synchronous control of gafvano mirror 43 and image sensor 

process of step #630 of FIG. 40. 53. In these drawings, the letter T of the symbols represents 

The functions of FIGS. 22 and 27 are realized by execut- a value of the telephoto state, and the letter "w" represents 

ing the following routine. The set intensity value of projec- a value of the wide telephoto state, 

tion in the main measurement is initialized as the upper limit 65 Since the field angle is deflected via zoom magnification 

value in consideration of human safety (#6301), and the top in three-dimensional camera 2, the deflection angle Ow 

line vl is targeted (#6302). If the preliminary measurement during low magnification can be greater than the deflection 
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angle 6t at high magnification. When system controller 61 2. The three-dimensional measuring device as claimed in 

detects a release signal S27 release button 27, the time T2 claim 1 wherein said optical projection system includes an 

after galvano mirror starts rotating until imaging starts, Le., adjusting means for adjusting size of said light beam in 

the time required for galvano mirror 43 to rotate from the accordance with the detection result of the detection means. 

stop position to a rnecktermined angle position, is calculated 5 3. The three-dimensional measuring device as claimed in 

based on the zoom magnification and the object distance. At claim 2 wherein said adjusting means includes a variator 

this time the deflection angular speed at Ume T2 is set at the leQS for varying ^ diameter of the laser beam. 

same value at the angular speed o> at sensor actuation ume A tu« *uL.-a:~*—- i _ _ * j , - » . 

rrt , *\ r 7T, k c± i * 4. Ine three -dimensional measuring device as claimed in 

Ts. The angular speed to is stable. After the calculation of » ■ t „^„- - A „ , . . , 

time T2 1S »mpl3erf, the rotational drive of galvano mirror „ chan . 1 wter ? ln ^ f °P bcal recc P? on ^ «*«*?» » 

43 starts, and the drive of image sensor S3 starts after a time 10 ^"^T f °' ^8 the . s,2e ° f ^ °P hcal 

12 has elapsed. image of the object on the image sensing surface. 

In the state wherein the system controller 61 directly 5 * ^ three-dimensional measuring device as claimed in 

controls both the galvano mirror 43 and image sensor 53, claim 4 °P tical reception system includes an 

system controller 61 galvano high speed processing to adjusting means for adjusting size of said light beam in 

accurately align the drive timings. On the other hand, it is 15 accordance with the detection result of the detection means, 

possible to reduce the load of control by having system and said zoom mechanism determines a magnification ration 

controller 61 control galvano mirror 43 only by using a in response to said adjusted size of the light beam, 

commercial video timing generator or special hardware to 6. The three-dimensional measuring device as claimed in 

drive the sensor. claim 1, further comprising: 

Tnat is, in FIG. 45, the driver 55 (refer to FIG. 3) 20 a detector for detecting for front principal point position 

standardizes release signal S27 via the rising edge of video of ^ optical reception means 

synchromz^sipal Vsync and generates a release warning 7 A three-dimensional measuring method comprising 

signal S2T. Driver 55 starts the sensor actuation at the Q f. r & 
moment a time TO has elapsed after the rise of the release 

warning signal S2T. The release warning signal S2T is input ^ eliminating an object with light beam; 

to system controller 61 as an interrupt signal. System forming an optical image of the object on an image 

controller 61 calculates the aforesaid time T2 at the start f the sensing surface of an image sensor by an optical 

release operation, and a time IT (=T0'-T2) from the rise of reception system; 

release warning signal S2T until the start of mirror rotation. outoutting image signals corresponding to the amount of 

When the interrupt of release warning signal S2T is fight impinging the image sensing surface; 

received, the galvano mirror rotation starts at the moment 30 , . \ *T . , . . ' 

time IT has elapsed thereafter. detecting the principal point position of said optical 

Although the present invention has been described by way reception system; and 

of examples of measurement via the light section method in calculating a three-dimensional position of the object 

the above embodiment, the measurement method is not based on the detected principal point position and the 

limited to light section methods, inasmuch as, for example, 35 image signals. 

pattern imaging methods may be used. In pattern imaging 8. The three-dimensional measuring method as claimed in 

methods, The measurable distance range is determined by claim 7 further comprising a step of a adjusting size of said 

the relationship between the pattern projection direction and light beam in accordance with the detected principal point 

the field of light reception. Furthermore, it may happen the position. 

that the reflected light of the partem cannot be detected, or 40 9. The three-dimensional measuring device as claimed in 

an overflow may occur in the light reception system due to claim 8 wherein said adjustment of the light beam size is 

the reflectivity of the object similar to thai in the light section executed by a variator lens for varying the diameter of the 

methods; in such cases, warning may be implemented. laser beam. 

Although the present invention has been fully described 10. A three-dimensional measuring device which projects 

by way of examples with reference to the accompanying 45 Kght on an object and senses the light reflected by said object 

drawings, it is to be noted that various changes and modi- under variable measurement conditions of the object to 

fications will be apparent to those skilled in the art. obtain three-dimensional positions of the object, said three- 

Therefore, unless otherwise such changes and modifications dimensional measuring device comprising; 

depart from the scope of the present invention, they should a judging means for judging whether said measurement 

be ronstrued as being included therein. conditions of the object are acceptable or not; and 

What is claimed is: 50 F ....... . J 

1. A tfrrecKhmensional measuring device comprising- a warmng means for warmrig if said jiidging means judges 

x. n ^ ^ r'. that said measurement conditions of the object are not 

an optical projection system w^ acceptable. 

with fight beam, 11. The three-dimensional measuring device as claimed in 

an image sensor which outputs image signals correspond- claim 10 further comprising a detection means for detecting 

ing to the amount of light impinging the image sensing a distance to the object as the measurement condition, 

sur ^ ce » wherein said judging means judges whether the detected 

an optical reception system which forms an optical image distance is acceptable or not. 

of the object on the image sensing surface of said image 12. The three-dimensional measuring device as claimed in 

sensor, the optical reception system employing a zoom- claim 11 wherein said a detection means detects the distance 

ing function; and 60 by executing preliminary measurement prior to an actual 

a calculator for calculating a three-dimensional position measurement 

of the object based on a front principal point position of 13. The three-dimensional measuring device as claimed in 

said optical reception system and the image signals of claim 10 wherein said measuring conditions include an 

the object obtained by said image sensor, the front amount of the light reflected by the object, and said judging 

principal piont position being applied for reducing an 65 means judges whether said light amount is acceptable or not. 
accident error arising from the zooming function of 

said optical reception system. ♦ * * * * 
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